External Quality Assessment of SARS-CoV-2 Sequencing: an ESGMD-SSM Pilot Trial across 15 European Laboratories.

This first pilot trial on external quality assessment (EQA) of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) whole-genome sequencing, initiated by the European Society of Clinical Microbiology and Infectious Diseases (ESCMID) Study Group for Genomic and Molecular Diagnostics (ESGMD) and the Swiss Society for Microbiology (SSM), aims to build a framework between laboratories in order to improve pathogen surveillance sequencing. Ten samples with various viral loads were sent out to 15 clinical laboratories that had free choice of sequencing methods and bioinformatic analyses. The key aspects on which the individual centers were compared were the identification of (i) single nucleotide polymorphisms (SNPs) and indels, (ii) Pango lineages, and (iii) clusters between samples. The participating laboratories used a wide array of methods and analysis pipelines. Most were able to generate whole genomes for all samples. Genomes were sequenced to various depths (up to a 100-fold difference across centers). There was a very good consensus regarding the majority of reporting criteria, but there were a few discrepancies in lineage and cluster assignments. Additionally, there were inconsistencies in variant calling. The main reasons for discrepancies were missing data, bioinformatic choices, and interpretation of data. The pilot EQA was overall a success. It was able to show the high quality of participating laboratories and provide valuable feedback in cases where problems occurred, thereby improving the sequencing setup of laboratories. A larger follow-up EQA should, however, improve on defining the variables and format of the report. Additionally, contamination and/or minority variants should be a further aspect of assessment.

Assessing the Quality of Serological Testing in the COVID-19 Pandemic: Results of a European External Quality Assessment (EQA) Scheme for Anti-SARS-CoV-2 Antibody Detection.

External quality assessment (EQA) is a key instrument for achieving harmonization, and thus a high quality, of diagnostic procedures. As reliable test results are crucial for accurate assessment of SARS-CoV-2 infection prevalence, vaccine response, and immunity, and thus for successful management of the ongoing COVID-19 pandemic, the Reference Institute for Bioanalytics (RfB) was the first EQA provider to offer an open scheme for anti-SARS-CoV-2 antibody detection. The main objectives of this EQA were (i) to gain insights into the current diagnostic landscape and the performance of serological tests in Europe and (ii) to provide recommendations for diagnostic improvements. Within the EQA, a blinded panel of precharacterized human serum samples with variable anti-SARS-CoV-2 antibody titers was provided for detection of anti-SARS-CoV-2 IgG, IgA, and IgM antibodies. Across the three distribution rounds in 2020, 284 laboratories from 22 countries reported a total of 3,744 results for anti-SARS-CoV-2 antibody detection using more than 24 different assays for IgG. Overall, 97/3,004 results were false for anti-SARS-CoV-2 IgG, 88/248 for IgA, and 34/124 for IgM. Regarding diagnostic sensitivity and specificity, substantial differences were found between the different assays used, as well as between certified and noncertified tests. For cutoff samples, a drop in the diagnostic sensitivity to 46.3% and high interlaboratory variability were observed. In general, this EQA highlights the current variability of anti-SARS-CoV-2 antibody detection, technical limitations with respect to cutoff samples, and the lack of harmonization of testing procedures. Recommendations are provided to help laboratories and manufacturers further improve the quality of anti-SARS-CoV-2 serological diagnostics.

Results of the first pilot external quality assessment (EQA) scheme for anti-SARS-CoV2-antibody testing.

Objectives Assessment of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection prevalence and immunity is cornerstones in the fight against COVID-19 pandemic. For pandemic control, reliable assays for the detection of anti-SARS-CoV-2 antibodies are required. This pilot external quality assessment (EQA) scheme aimed to independently assess the participants' clinical performance of anti-SARS-CoV-2 testing, to identify shortcomings in clinical practice and to evaluate the suitability of the scheme format. Methods The EQA scheme consisted of eight serum samples with variable reactivity against SARS-CoV-2 intended for the analysis of anti-SARS-CoV-2 immunoglobulin (Ig)G, IgA, and IgM antibodies. Laboratories reported: (1) results for each sample and the respective method, (2) raw data from replicate testing of each sample. Results The 16 selected pilot EQA participants reported 294 interpreted results and 796 raw data results from replicate testing. The overall error rate for the anti-SARS-CoV-2 IgG, IgA, and IgM tests was 2.7, 6.9, and 16.7%, respectively. While the overall diagnostic specificity was rated as very high, sensitivity rates between 67 and 98% indicate considerable quality differences between the manufacturers, especially for IgA and IgM. Conclusions Even the results reported by the small number of participants indicate a very heterogeneous landscape of anti-SARS-CoV-2 serological testing. Differences of available tests and the individual performance of laboratories result in a success rate of 57.1% with one laboratory succeeding for all three antibody-classes. These results are an incentive for laboratories to participate in upcoming open EQA schemes that are needed to achieve a harmonization of test results and to improve serological testing.